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Abstract. In this paper, we investigate the problem of semi-global minimal time robust sta- 
bilization of analytic control systems with controls entering linearly, by means of a hybrid state 
feedback law. It is shown that, in the absence of minimal time singular trajectories, the solutions of 
the closed-loop system converge to the origin in quasi minimal time (for a given bound on the con- 
troller) with a robustness property with respect to small measurement noise, external disturbances 
and actuator noise. 
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1. Introduction. Let m and n be two positive integers. Consider on R" the 
control system 

m 

x{t) = Y,<t)fMt)), (1-1) 

1=1 

where /i , . . . , /„ are analytic vector fields on H" , and where the control function 
u{-) = (wi(-), . . . ,Um(-)) satisfies the constraint 

m 

Y.u,{tf^l. (1.2) 

i=l 

All results of this paper still hold on a Riemannian analytic manifold of dimension 
n, which is connected and complete. However, for the sake of simplicity, our results 
are stated in H". Let x £ R". The system together with the constraint \i.2\ . 

is said globally asymptotically stabilizahle at the point x, if, for each point x £ M", 
there exists a control law satisfying the constraint H1.2|l such that the solution of 
associated to this control law and starting from x tends to x as t tends to +00. 

This asymptotic stabilization problem has a long history and has been widely 
investigated. Note that, due to Brockett's condition Theorem 1, (iii)], if to < n, 
and if the vector fields are independent, then there does not exist any 

continuous stabilizing feedback law for However several control laws have been 

derived for such control systems (see for instance jSl I29j and references therein) . 

The robust asymptotic stabilization problem is under current and active research. 
Many notions of controllers have been introduced to treat this problem, such as discon- 
tinuous sampling feedbacks jl9[ I45| . time varying control laws 20, 21, 33, 34 , patchy 
feedbacks (as in [S]), SRS feedbacks enjoying different robustness properties 

depending on the errors under consideration. 

In the present paper, we consider feedback laws having both discrete and con- 
tinuous components, which generate closed-loop systems with hybrid terms (see for 
instance ^2021)- Such feedbacks appeared first in |37] to stabilize nonlinear systems 
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having a priori no discrete state. They consist in defining a switching strategy between 
several smooth control laws defined on a partition of the state space. Many results 
on the stabilization problem of nonlinear systems by means of hybrid controllers have 
been recently established (see for instance |14ll22[[^ f26 30, 32, 35, 53 ). The notion 
of solution, connected with the robustness problem, is by now well defined in the 
hybrid context (see [251 139| among others) . Specific conditions for the optimization 
can be found in the literature (see e.g. pi I24j ) . 

The strategy of our paper is to combine a minimal time controller that is smooth 
on a part of the state space, and other controllers defined on the complement of this 
part, so as to provide a quasi minimal time hybrid controller by defining a switching 
strategy between all control laws. The resulting hybrid law enjoys a quasi minimal 
time property, and robustness with respect to (small) measurement noise, actuator 
errors and external disturbances. 

More precisely, in a first step, we consider the minimal time problem for the 
system with the constraint (|1.2|) . of steering a point x G R" to the point x. 

Note that this problem is solvable as soon as the Lie Algebra Rank Condition holds 
for the m-tuple of vector fields (/i, . . . , /,„). Of course, in general, it is impossible to 
compute explicitly the minimal time feedback controllers for this problem. Moreover, 
Brockett's condition implies that such control laws are not smooth whenever m < n 
and the vector fields are independent. This raises the problem of the 

regularity of optimal feedback laws. The literature on this subject is immense. In an 
analytic setting, the problem of determining the analytic regularity of the minimal 
time function has been, among others, investigated in 07|. For systems of the form 
, it follows from ^ |21 15U| that the minimal time function to x is subanalytic, 
provided there does not exist any nontrivial singular minimal time trajectory starting 
from X (see [37| for a general definition of subanalytic sets). This assumption 
holds generically for systems whenever m ^ 3 (see Ql]). In particular, this 

function is analytic outside a stratified submanifold S of M", of codimension greater 
than or equal to 1 (see @HI)- As a consequence, outside this submanifold it is possible 
to provide an analytic minimal time feedback controller for the system (|l.lf) . (|1.2f) . 
This optimal controller gives rise to trajectories never crossing again the singular set 
S. 

Note that the analytic context is used so as to ensure stratification properties, 
which do not hold a priori if the system is smooth only. These properties are related 
to the notion of o-minimal category (see j23|V 

In a neighborhood of S, we prove the existence of a set of controllers steering the 
system (|1.2|l outside of this neighborhood in small time. 

Then, in order to achieve a minimal time robust stabilization procedure, using 
a hybrid feedback law, we define a suitable switching strategy (more precisely, a 
hysteresis) between the minimal time feedback controller and other controllers defined 
in a neighborhood of S. The resulting hybird system has the following property: if 
the state is close to the singular submanifold S, the feedback controller will push the 
state far enough from 5, in small time; if the state is not too close to S, then the 
feedback controller will steer the system to x in minimal time. Hence, the stabilization 
is quasi-optimal, and is proved to enjoy robustness properties. 

Note that we thus give an alternative solution, in the context of hybrid systems 
using hysteresis, to a conjecture of |15[ Conj. 1, p. 101] concerning patchy feedbacks 
for smooth control systems.^ 
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In a previous paper j41j . this program was achieved on the so-called Brockett 
system, for which n = 3, m — 2, and, denoting x = (xi, X2, x^), 

J, d d . d d 

/I = "5 ''^2-5 — , J2 = "5 xi- — . 

ox I 0x3 0x2 0x3 

In this case, there does not exist any nontrivial singular trajectory, and the manifold 
S coincides with the axis (Oxs). A simple explicit hybrid strategy was described. In 
contrast, in the present paper, we derive a general result that requires a countable 
number of components in the definition of the hysteresis hybrid feedback law. 

The paper is organized as follows. In Section [3 we first recall some facts about 
the minimal time problem for the system with (|1.2|l , and recall the definition of 
a singular trajectory. Then, we give a notion of solution adapted to hybrid feedback 
laws, and define the concept of stabilization via a minimal time hybrid feedback law. 
The main result, Theorem 12. 101 in Section states that, if there does not exist any 
nontrivial singular minimal time trajectory of p. 1(1 . 1(1. 2|l . starting from x, then there 
exists a minimal time hybrid feedback law stabilizing semi-globally the point x for 
the system ((1.1(1 . ((1.2(1 . Section describes the main ideas of the proof of the main 
result, and in particular, contains two key lemmas. Section |21 is then devoted to the 
detailed proof of Theorem 12. lUI and gathers all technical aspects needed to deal with 
hybrid systems: the components of the hybrid feedback law, and a switching strategy 
between both components are defined, and properties of the closed-loop system are 
investigated. 

The results in this work were announced in (42| . 

2. Definitions and main result. 

2.1. The minimal time problem. Consider the minimal time problem for the 
system ((1.1(1 with the constraint ((1.2(1 . 

Throughout the paper, we assume that the Lie Algebra Rank Condition holds, 
that is, the Lie algebra spanned by the vector fields /i, . . . ,/,„ is equal to H", at 
every point x of M" . 

It is well known that, under this condition, any two points of M" can be joined 
by a minimal time trajectory of 1(1.1(1 . ((1.2(1 . 

Let X € H" be fixed. We denote by Tj(x) the minimal time needed to steer the 
system ((1.1(1 with the constraint ((1.2(1 from a point x £ R" to the point x. 

Remark 2.1. Obviously, the control function u associated to a minimal time 
trajectory of ((1.1(1 . ((1.2(1 . actually satisfies X^IHi = 1- 

For T > 0, let Ut denote the (open) subset of u(-) in L°°([0, T], R") such that 
the solution of ((1.1(1 . starting from x and associated to a control tt(-) e Ut, is well 
defined on [0,r]. The mapping 

Ex T '■ Ut — > IR" 

u{-) ^ x{T), 

which to a control u{-) associates the end-point x{T) of the corresponding solution 
x{-) of ((1.1(1 starting at x, is called end-point mapping at the point x, in time T; it is 



during the review process of the present work, the authors prove, using a penalization method, a 
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a smooth mapping. 

Definition 2.2. A trajectory x(-) of so that a;(0) = x, is said singular on 

[0,T] if its associated control u{-) is a singular point of the end-point mapping E^.t 
{i.e., if the Frechet derivative of E^^t at u(-) is not onto). The control u{-) is said 
singular. 

Remark 2.3. If x{-) is singular on [0, T], then it is singular on [ioi^i], for all 
to,ti e [0,T] such that to < ti. 

Remark 2.4. It is a standard fact that the minimal time control problem for the 
system (|l.lf) with the constraint H1.2I) . is equivalent to the sub-Riemannian problem 
associated to the m-tuple of vector fields (/i, . . . , /„) (see QUI for a general defini- 
tion of a sub-Riemannian distance). In this context, there holds T^{x) = dsR{x,x), 
where dgj^ is the sub-Riemannian distance. This implies that the functions Tj(-) and 
dsR{x,-) share the same regularity properties. In particular, the function T'g(-) is 
continuous. 

2.2. Class of controllers and notion of hybrid solution. Let / : M" x 

H™ H" be defined by f{x, u) = i uj,{x). The system ((TTJ writes 

x{t) = f{x{t),u{t)). (2.1) 

Let S e M" be fixed. 

The controllers under consideration in this paper depend on the continuous state 
X £ IR" and also on a discrete variable Sd G A/", where TV is a nonempty subset of 
N. According to the concept of a hybrid system of |2S], we introduce the following 
definition. 

Definition 2.5. A hybrid feedback is a 4-tuple (C, I?, fc, fc^), where 

• C and D are subsets of H" x Af; 

• /fc : R" X A/" ^ R™ is a function; 

• kd : M" X A/" ^ A/" is a function. 

The sets C and D are respectively called the controlled continuous evolution set and 
the controlled discrete evolution set. 

We next recall the notion of robustness to small noise (see 0E1)- Consider two 
functions e and d satisfying the following regularity assumptions: 

e(-,-),rf(T)eL,~(]R"x[0,+oo);IR"), 
e(-,t),d(-,<) e C°(]R",]R"), Vte[0,+cx)). 

We introduce these functions as a measurement noise e and an external disturbance d. 

Formally, the /c-component of a hybrid feedback {k,kd,C, D) governs the differ- 
ential equation 

X — f{x, k{x + e)) + d , V{x, Sd) £ C, 

whereas the fc^j-component governs the jump equation 

Srf = kd{x,Sd) , y{x,Sd) e D. 

The set C indicates where in the state space flow may occur while the set D indicates 
where in the state space jumps may occur. The collection of this flow equation and 
of this jump equation, under the perturbations e and d, is a perturbed hybrid system 
T^(e,d), as considered e.g. in ,26,. We next provide a precise definition of the notion of 
solutions considered here. 
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This concept is well studied in the literature (see e.g. [TTl [Tl ISTl 051 15^ HU] ). 

Here, we consider the notion of solution given in |25l I26| . 

Definition 2.6. Let S = U/Jo x {j}^ where J e IN U {+00} and 

(xqjSo) G II" X The domain S is said to be a hybrid time domain. A map 
(x, Sd) '. S H" X Af is said to be a solution of 'H{e,d) with the initial condition 

(xo,so) if 

• the map x is continuous on S] 

• for every j, ^ j ^ J — 1, the map x : t ^ (tj,tj-^-i) 1— > x{t,j) is absolutely 
continuous; 

• for every j, ^ j ^ J — 1 and almost every t ^ 0, {t,j) e S', we have 

{x{t,j) + e{x{t,j),t),Sd{t,j))eC, (2.3) 

and 

i(t,j) = /(x(0,fc(x(t,j)+e(a:(t,j),i),Sd(<,j)))+'^(-'c(i,j),t), (2-4) 
Sd{t, j)^0; (2.5) 

(where the dot stands for the derivative with respect to the time variable t) 

• for every (i, j) G S, {t,j + 1) € S, we have 

{x{t,j)+e{x{t,j),t),Sd{t,j)) e 7^, (2.6) 

and 

x{t,j + l)=x{t,j), (2.7) 

Sd(i, J + 1) - fcd(a;(t, j) + e(x(i, j), t), Sd(i, j)); (2-8) 

• (x(0,0),Sd(0,0)) = (xo,so). 

In this context, we next define the concept of stabilization of (|2.1() by a minimal 
time hybrid feedback law sharing a robustness property with respect to measurement 
noise and external disturbances. The usual Euclidean norm in R" is denoted by 
1 • I, and the open ball centered at x with radius R is denoted B{x,R). Recall that 
a function of class /Coo is a function 6: [0, +00) —^ [0, +00) which is continuous, 
increasing, satisfying S{0) = and lim/f^+00 ^(R) = +00. 

As usual, the system is said complete if all solutions are maximally defined in 
[0, +CX3) (see e.g. FTI). More precisely, we have the following definition. 

Definition 2.7. Let p : R" ^ R be a continuous function satisfying 

pix) > 0, Vx 7^ X. (2.9) 

We say that the completeness assumption for p holds if, for all (e, d) satisfying the 
regularity assumptions H2.2|l . and so that, 

sup[o,+oo)|e(2^, Ol < Pi^), esssup[o,+oo) M(a;, •)! p{x), Va; G R", (2.10) 

for every {xo,so) G R" x Af, there exists a maximal solution on [0, +00) of 'H(e,d) 
starting from (xo, sq). 

Roughly speaking, the finite time convergence property means that all solutions 
reach x within finite time. A precise definition of this concept follows. 

Definition 2.8. We say that the uniform finite time convergence property holds 
if there exists a continuous function p : R" R satisfying H2.9|l . such that the 
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completeness assumption for p holds, and if there exists a function 5 : [0, +cxd) 
[0, +CX3) of class /Coo such that, for every i? > 0, there exists r = t{R) > 0, for all 
functions e, d satisfying the regularity assumptions H2.2|l and inequalities (|2.1(Jf) for 
this function p, for every Xq € B{x,R), and every sq G A/", the maximal solution 
(x, Sd) ofTi.(e.d) starting from (xq^sq) satisfies 

\xit,j) - m), > 0, e 5, (2.11) 

and 

x{t,j) = x, "it-^T, {t,j) E S. (2.12) 



We are now in position to introduce our main definition. It deals with closed- 
loop systems whose trajectories converge to the equilibrium within quasi-minimal 
time and with a robustness property with respect to measurement noise and external 
disturbances. 

Definition 2.9. The point x is said to be a semi- globally quasi-minimal time 
robustly stabilizable equilibrium for the system (I2.1|l if, for every e > and every 
compact subset K C R", there exists a hybrid feedback law {C, D, k, kd) satisfying 
the constraint 

||A:(x,s<j)|K 1, (2.13) 

where || • |j stands for the Euclidean norm in M™, such that: 

• the uniform finite time convergence property holds; 

• there exists a continuous function p^ K ■ E," H satisfying l|2.9() for p = 
Pe,K, such that, for every (a;o,so) E K x A/", all functions e,d satisfying the 
regularity assumptions (|2.2|) and inequalities H2.10|l for p = Pe.K, the maximal 
solution of 7i(g starting from (xq, sq) reaches x within time Tx{x())-\-e, where 
Tj(xo) denotes the minimal time to steer the system (|2.1|l from xq to x, under 
the constraint ^ 1. 

2.3. Main result. The main result of this article is the following. 

Theorem 2.10. Let x G R". If there exists no nontrivial minimal time singular 
trajectory of Hl.l|l . (|1.2|) . starting from x, then x is a semi-globally quasi-minimal time 
robustly stabilizable equilibrium for the system (|1.1|) . under the constraint (|1.2|l . 

Remark 2.11. The problem of global quasi- minimal time robust stabilization 
{i.e. K = H" in Definition I2.9|l cannot be achieved a priori because measurement 
noise may then accumulate and slow down the solution reaching x (compare with 

USD- 

Remark 2.12. The assumption of the absence of nontrivial singular minimizing 
trajectory is crucial. Notice the following facts, which show the relevance of this 
assumption: 

• if m ^ n and if the vector fields /i, . . . , fm, are everywhere linearly indepen- 
dent, then there exists no singular trajectory. In this case, we are actually in 
the framework of Riemannian geometry (see Remark |2 .4(1 . 

• Let J-m be the set of m-tuples of linearly independent vector fields (/i, . . . , /m), 
endowed with the C°° Whitney topology. If m ^ 3, there exists an open dense 
subset of J-m, such that any control system of the form (|l.l|l . associated to 
a m-tuple of this subset, admits no nontrivial singular minimizing trajectory 
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(see El , see also [2] for the existence of a dense set only) . Hence generi- 
cally the conclusion of Theorem I2.1UI holds without assuming the absence of 
nontrivial singular minimizing trajectories. 
• If there exist singular minimizing trajectories, then the conclusion on sub- 
analyticity of the function T may fail (see ^USHj), and we cannot a priori 
prove that the set S of singularities of T is a stratifiable manifold, which is 
the crucial fact in order to define a hybrid strategy. 

2.4. Short description of the proof. The strategy of the proof of Theorem 
I2.1UI is the following. 

Under the assumption of the absence of nontrivial singular minimal time trajec- 
tory, the minimal time function associated to the system (ll.lll . (I1.2|) . is subanalytic, 
and hence, is analytic outside a stratified submanifold S of M", of codimension greater 
than or equal to one. Therefore, the corresponding minimal time feedback controller 
(further precisely defined in Section l5.2.3|l is continuous (even analytic) on IR"\5 (see 
Figure |OJ. In a neighborhood of 5, it is therefore necessary to use other controllers, 
and then to define an adequate switching strategy. 




Fig. 2.1. Switching strategy. 

More precisely, the proof of Theorem 12 . lUI relies on both following key lemmas. 

Lemma 2.13. For every e > 0, there exists a neighborhood of 5 such that, for 
every stratum^ Mi of 5, there exist a nonempty subset TVi of K, a locally finite family 
(f^i,p)pe7Vi of open subsets of fi, a sequence of smooth controllers Ui^p defined in a 
neighborhood of f2i,p, satisfying ||Mi,p|| 5j 1, and there exists a continuous function 
Pi^p : M" — » [0, -|-oo) satisfying pi^p{x) > whenever x ^ x, such that every solution 
of' 

x{t) = f{x{t),u^,p(x{t) + e{x{t), t))) + d{x{t), t), (2.14) 

Since 5 is a stratified submanifold of ]R" of codimension greater than or equal to one, there 
exists a partition (Mi)igiN of S, where Mi is a stratum, i.e., a locally closed submanifold of TR". 
Recall that, if Mi n dMj 0, then Mi C Mj and dim{M,;) < dim(Mj). 
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where e, d : M" x [0, +00) M" are two functions satisfying the regularity assump- 
tions H2.2|) and 

sup[o^+oo)|e(2^, Ol < PiA^)^ esssup[o_+^)|d(a;, •)! ^ PiA^)' (2-15) 

starting from Qi^p and maximally defined on [0, T), leaves within time e; moreover, 
there exists a function di^p of class ICoo such that, for every R > 0, every such solution 
starting from fi^^j, n B{x, R) satisfies 

\xit)-x\ ^ S,^piR), vt e [o,r). (2.16) 

According to this lemma, in a neighborhood of 5, there exist controllers steering 
the system outside ft. Moreover, since this neighborhood can be chosen arbitrarily 
thin, the time s needed for its traversing is arbitrarily small. 

Outside fl, the optimal controller is analytic. The following lemma shows that 
this controller shares an invariance property; in brief, it gives rise to trajectories never 
crossing again the singular set S. 

Lemma 2.14. For every neighborhood U oi S \ {x} in M", there exists a neigh- 
borhood il' of iS \ {x} in H", satisfying 

n' c cios(r2') c n, (2.17) 

such that every trajectory of the closed-loop system Hl.l(l with the optimal controller, 
starting from any point x £ M" \ reaches x in minimal time, and is contained in 
R" \ Q'. 

Finally, our hybrid strategy is the following. For every £ > 0, there exists a 
neighborhood O of the singular set S, and there exist controllers which steer the 
system outside this neighborhood in time less than e. Outside O, there exists a 
continuous controller and giving rise to trajectories never crossing again S and joining 
X in minimal time. 

It is therefore necessary to define an adequate switching strategy connecting both 
controllers (see Figure l^^. This is achieved in the context of hybrid systems, using 
an hysteresis strategy. The first component consists of controllers which are defined 
in and whose existence is stated in Lemma 12.131 The second component of the 
hysteresis is defined by the optimal controller, outside fi; Both components are united 
using an hysteresis, by adding a dynamical discrete variable Sd and using a hybrid 
feedback law. With this resulting hybrid controller, the time needed to join x, from 
any point xq of H", is less than Tg(xo) 4- e. 

The next section, devoted to the detailed proof of Theorem l2.1UI is organized as 
follows. 

The first component of the hysteresis is defined in Section l3. II and Lemma 12.131 
is proved. 

SectionO 

concerns the definition and properties of the second component of the 
hysteresis, defined by the minimal time controller. In Section 13.2.11 we recall how to 
compute minimal time trajectories of the system (ll.l|l . (|1.2|) . using the Pontryagin 
Maximum Principle. We then provide in Section l5.2.2l a crucial result on the cut locus 
("Proposition 13 . 6|l . The optimal feedback controller is defined in Section ni2. 31 basic 
facts on subanalytic functions are recalled, permitting to define the singular set S. 
Invariance properties of this optimal controller are then investigated: Lemma 12.141 is 
proved in Section [3.2.4l robustness properties are given and proved in Section [3. 2. 51 
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The hybrid controller is then defined in Section 13.31 A definition of a hybrid 
control system, and properties of solutions, are given in Sections 13 . 3 . II and 13 .3 . 2l A 
precise description of the switching strategy is provided in Section 13.3.31 Theorem 
12.101 is proved in Section 

3. Proof of Theorem I2TT0I In what follows, let x G R" be fixed. 

3.1. The first component of the hysteresis. The first component of the 
hysteresis consists of a set of controllers, defined in a neighborhood of S, whose 
existence is stated in Lemma |2. 131 Hereafter, we provide a proof of this lemma. 

Proof. [Proof of Lemma l2 .13) First of all, recall that, on the one hand, the minimal 
time function coincides with the sub-Riemannian distance associated to the m-tuple 
(/i, . . . , fm) (see Remark 12.411 : on the other, since the Lie Algebra Rank Condition 
holds, the topology defined by the sub-Riemannian distance dsn coincides with the 
Euclidean topology of M", and, since is complete, any two points of IR" can be 
joined by a minimizing path (see |l()p. 

Let e > fixed. Since 5 is a stratified submanifold of H", there exists a neigh- 
borhood of iS satisfying the following property: for every y £ S, there exists 
z £ IR" \ clos(rj) such that dsRiy, z) < e. 

Consider a stratum Mi of S. For every y £ Mi, let z G H" \ clos(i7) such 
that dsR{y,z) < e. The Lie Algebra Rank Condition implies that there exists an 
open-loop control t i— > Uy{t), defined on [0,T) for a T > e, satisfying the constraint 
\\uy\\ < 1, such that the associated trajectory Xy{-) (which can be assumed to be 
one-to-one), solution of (|1.1|) . starting from y, reaches z (and thus, leaves clos(ri)) 
within time e. Using a density argument, the control Uy can be moreover chosen as a 
smooth function (see |10[ Theorem 2.8 p. 21] for the proof of this statement). Since 
the trajectory is one-to-one, the open-loop control t Uy{t) can be considered as a 
feedback t i—>- Uy{xy{t)) along Xy{-). Consider a smooth extension of Uy on ]R", still 
denoted Uy, satisfying the constraint ||uy(a;)|| ^ 1, for every x G M". By continuity, 
there exists a neighborhood fly of y, and positive real numbers Sy and py, such that 
every solution of 

xit) = f{x{t), uy{x{t) + e{x{t),t))) + d{x{t),t), (3.1) 

where e, d : IR" x [0, +00) R" are two functions satisfying the regularity assump- 
tions l|2.2|l and 

suP[o,+oo)|e(a;,-)l ^ Py, esssup[o +^)|d(a;,-)| ^ Py , 
starting from fly and maximally defined on [0,T), leaves D, within time e; moreover, 

\x{t)~x\^Sy, Vie [0,T). 

Repeat this construction for each y G Mi. 

Now, on the one hand, let {yp)p^Mi be a sequence of points of Mi such that the 
family {^yj,)pej\fi is a locally finite covering of Mi, where A/i is a subset of IN. Define 
r^ip — and Ui^p — ^yp' 

On the other hand, the existence of a continuous function pi^p : IR" — > [0, +00), 
satisfying pi_p(x) > whenever x ^ x, follows for the continuity of solutions with 
respect to disturbances. The existence of a function 6i^p of class A^oo such that 1)2.16)1 
holds is obvious. 

Repeat this construction for every stratum Mi of S. Then, the statement of the 
lemma follows. □ 



10 



C. PRIEUR AND E. TRELAT 



3.2. The second component of the hysteresis. 

3.2.1. Computation of minimal time trajectories. Let xi G R", and x( ) 

be a minimal time trajectory, associated to a control u(-), steering the system Hl.lf) . 
(|1.2II . from a: to Xi, in time T — Tg(xi). According to Pontryagin's maximum prin- 
ciple (see j36)). the trajectory x{-) is the projection of an extremal, i.e., a triple 
{x{-),p(-),u{-)) solution of the constrained Hamiltonian system 

dH OH 
x{t) = —{x{t),pit),uit)), Pit) - - — {x{t),pit),uit)), 



H{x{t),p{t),p°,u{t)) ^ max H{x{t),p{t),p" ,v), 
almost everywhere on [0, T], where 

m 

H{x,p,u) = ^w,(p,/j(x)) 

4=1 

is the Hamiltonian of the optimal control problem, and p(-) (called adjoint vector) is 
an absolutely continuous mapping on [0,T] such that p{t) e H" \ {0}. Moreover, the 
function t ^ max||„||^]^ H{x{t),p{t),p^ , v) is Lipschitzian, and everywhere constant on 
[0, T]. If this constant is not equal to zero, then the extremal is said normal; otherwise 
it is said abnormal. 

Remark 3.1. Any singular trajectory is the projection of an abnormal extremal, 
and conversely. 

Controls associated to normal extremals can be computed as 

^■-) , M^)^i^(^W) . . (3.2) 



Indeed, note that, by definition of normal extremals, the denominator of H3.2|l cannot 
vanish. It follows that normal extremals are solutions of the Hamiltonian system 

ciH f)H 

±{t) = ^{x{t),p{t)), p{t) = -^{x{t),p{t)), (3.3) 

where 



Hi{x,p) 



Y,{p,h{x))^ 



Notice that Hi{x{t),p{t)) is constant, nonzero, along each normal extremal. Since 
p(0) is defined up to a multiplicative scalar, it is usual to normalize it so that 
Hi{x{t),p{t)) = 1. Hence, we introduce the set 

X = {poeIl" I Hi{x,po) = 0}. 

It is a submanifold of M" of codimension one, since ^^{x,pq) = i(0) 7^ (see [T^ 
for a similar construction in the general case). There exists a connected open subset 
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U of [0, +00) X X such that, for every (t*,Po) G X^ the differential system ()3.3|l has 
a well defined smooth solution on [0, t*] such that x(0) = x and p(0) = po- 
Definition 3.2. The smooth mapping 

expg : U — > R" 

(i,Po) I — ' x{t) 

where {x{-),p{-)) is the solution of the system H3.3() such that a;(0) — x and p{0) = 
Po € X, is called exponential mapping at the point x. 

The exponential mapping parameterizes normal extremals. Note that the domain 
of expj is a subset of II x X which is locally diffeomorphic to M" (since we are in the 
normal case). 

Definition 3.3. A point x e expg{U) is said to be conjugate to x if it is a critical 
value of the mapping expg, i.e., if there exists (tc,Po) G U such that x = expg(tc,po) 
and the differential dexp^{tc,Po) is not onto. The conjugate locus of x, denoted by 
C{x), is defined as the set of all points conjugate to x. 

With the previous notations, define Cmin{x) as the set of points x G C{x) such 
that the trajectory 1 1-^ expj(t,po) is minimizing between x and x. 

3.2.2. The cut locus. A standard definition is the following. 

Definition 3.4. A point x e IR" is not a cut point with respect to x if there 
exists a minimal time trajectory of I|1.2|l . joining x to x, which is the strict 

restriction of a minimal time trajectory starting from x. The cut locus of x, denoted 
by C{x), is defined as the set of all cut points with respect to x. 

In other words, a cut point is a point at which a minimal time trajectory ceases 
to be optimal. 

Remark 3.5. In the analytic case, it follows from the theory of conjugate points 
that every nonsingular minimal time trajectory ceases to be minimizing beyond its 
first conjugate point (see for instance [3) El)- Hence, if there exists no singular 
minimal time trajectory starting from a;, then Cmm{x) C C{x). 

The following result on the cut locus is crucial for the proof of Theorem 12. 101 
Proposition 3.6. Assume that the vector fields fi,...,fm are analytic, and 
that there exists no singular minimal time trajectory starting from x. Then the set 
of points of H" where the function Tx{-) is not analytic is equal to the cut locus of x, 
that is 

Sing Ts(-) = C{x). (3.4) 

Remark 3.7. Under the previous assumptions, one can prove that the set of 
points of M" where Tx(-) is analytic is equal to the set of points where Tj(-) is of class 
C\ 

Proof. Let x e R" so that Tj(-) is analytic at x. Then there exists a neighborhood 
y of a; in H" such that Tx{-) is analytic on V. Let us prove that x ^ C{x). It follows 
from the maximum principle and the Hamilton- Jacobi theory (see |36| 1 that, for every 
y GV, there exists a unique minimal time trajectory joining x to y, having moreover 
a normal extremal lift {x{-),p(-),u{-)) satisfying 

p{T^{y)) = VT^{y) 

(compare with |44l Proposition 2.3]). Set Ui — expj^(y). It follows easily from 
Cauchy-Lipschitz Theorem that the mapping exp^ is an analytic diffeomorphism from 
Ui into V. Hence, obviously, the point x is not in the cut locus of x. 
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Conversely, let x ^ C{x). To prove that Trj.{-) is analytic at we need the two 
following lemmas. 

Lemma 3.8. The point x is not conjugate to a;, and is joined from a; by a unique 
minimal time trajectory. 

Proof. [Proof of Lemma 13.81 ] From the assumption of the absence of singular 
minimal time trajectory, there exists a nonsingular minimal time trajectory joining x 
to X. From Remark 13. 51 the point x is not conjugate to x. 

By contradiction, suppose that x is joined from x by at least two minimal time 
trajectories. By assumption, these two trajectories must admit normal extremal lifts. 
Since the structure is analytic, their junction at the point x is necessarily not smooth. 
This implies that both trajectories loose their optimality at the point x (indeed if not, 
there would exist a nonsmooth normal extremal, which is absurd), and thus x G C{x). 
This is a contradiction. □ 

Lemma 3.9. There exists a neighborhood V x in R" such that every point 
y ^ V IS not conjugate to x, and there exists a unique (nonsingular) minimal time 
trajectory joining x to y. 

Proof. [Proof of Lemma Let p^) ^ X so that x = exp5(Tg(a;),po)- Since 
X is not conjugate to x, the exponential mapping exp^ is a dilFeomorphism from a 
neighborhood C/i of (Tg(x),po) hi U into a neighborhood F of a; in M". Set U2 = 
expri(F). 

Let us prove that expg is proper from U2 into V . We argue by contradiction, and 
suppose that there exists a sequence (a;„)„£]N of points of V converging towards cc, 
such that for each integer n there exists p„ G X, satisfying {Tx{x„),Pn) G U2 and 
Xn — expg(Tj(x„),p„), such that (p„)„g]N is not bounded. It then follows from |51[ 
Lemmas 4.8 and 4.9] (see also |52 Fact 1 p. 378]) that x is joined from x by a singular 
control u. In particular, x is conjugate to x; this is a contradiction. 

Therefore, the set {p \ expj(T2(a;),p) = x} is compact in U2- Moreover, since x is 
not conjugate to x, this set has no cluster point, and thus is finite. As a consequence, 
up to reducing V, we assume that 1^ is a connected open subset oi exp^{U2), and that 
U2 is a finite union of disjoint connected open sets, all of which being diffeomorphic to 
V by the mapping expj. We infer that every point y G ^ is not conjugate to x. Hence, 
the mapping exp^ is a proper submersion from U2 into V, and thus is a fibration with 
finite degree. Since, from Lemma 13.81 there exists a unique minimal time trajectory 
joining x to x, this degree is equal to one, that is, exp^ is a diffeomorphism from U2 
into V. The conclusion follows. □ 

It follows from the previous lemma that {Tx{y),pQ) — exp'^^{y), for every y , 
and hence Tx{-) is analytic on T^. □ 

3.2.3. Definition of the optimal controller. By assumption, there does not 
exist any nontrivial singular minimal time trajectory starting from x. Under these 
assumptions, the function Tg(-) is subanalytic outside x (see [T101l5()j. combined with 
Remark IT^ . 

For the sake of completeness, we recall below the definition of a subanalytic 
function (see [271 128p. and some properties that are used in a crucial way in the 
present paper (see HH). 

Let M be a real analytic finite dimensional manifold. A subset A of M is said to 
be semi-analytic if and only if, for every x G M, there exists a neighborhood U of x 
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in M and 2pq analytic functions gij, hij {1 ^ i ^ p and 1 ^ j ^ 9), such that 

p 

AnU =[j{yeU \ g,j{y) = and h,,{y) >0, j = l...q}. 

1=1 

Let SEM(M) denote the set of semi-analytic subsets of M. The image of a semi- 
analytic subset by a proper analytic mapping is not in general semi- analytic, and 
thus this class has to be enlarged. 

A subset A of M is said to be subanalytic if and only if, for every x G M, there 
exist a neighborhood U of x in M and 2p couples ($^, A^) {1 ^ i ^ p and 6 = 1, 2), 
where Af e SEM{Mf), and where the mappings $f : Mf M are proper analytic, 
for real analytic manifolds Mf , such that 

Anu=[ji^liAl)\<i>^^iAf)). 

i=l 

Let SUB(Af ) denote the set of subanalytic subsets of M . 

The subanalytic class is closed by union, intersection, complementary, inverse 
image by an analytic mapping, image by a proper analytic mapping. In brief, the 
subanalytic class is o-minimal (see |23p. Moreover subanalytic sets are stratifiahle 
in the following sense. A stratum of a differentiable manifold M is a locally closed 
sub-manifold of M . A locally finite partition S of M is a stratification of M if any 
S" e 5 is a stratum such that 

VT e 5 Tr]dS ^%^T ^dS fmddimT < dim S. 

Finally, a mapping f : M N between two analytic manifolds is said to be 
subanalytic if its graph is a subanalytic subset of M x N. 

Let M be an analytic manifold, and / be a subanalytic function on M. The 
analytic singular support of / is defined as the complement of the set of points x in 
M such that the restriction of / to some neighborhood of x is analytic. The following 
property is of great interest in the present paper (see jH]): the analytic singular 
support of / is subanalytic (and thus, in particular, is stratifiable) . If / is moreover 
locally bounded on Af , then it is moreover of codimension greater than or equal to 
one. 

Turn back to our problem. The function Tx{-) is subanalytic outside x, and 
hence, its singular set S = Sing Tx{-) {i.e., the analytic singular support of Is(-)) is 
a stratified submanifold of M", of codimension greater than or equal to 1. 

Remark 3.10. Note that the point x belongs to the adherence of S (see pP). 

Outside the singular set S, it follows from the dynamic programming principle 
(see 12^1) that the minimal time controllers steering a point x G M" \S to x are given 
by the closed-loop formula 

..(.) = -^JSMM^, ^ = l,...,m. (3.5) 

^j:T=ii'^T,{x)j,{x))^ 

The objective is to construct neighborhoods of 5 \ {x} in H" whose complements 
share invariance properties for the optimal flow. This is the contents of Lemma 12.141 
proved next. 
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3.2.4. Proof of Lemma l2.14l It suffices to prove that, for every compact subset 
K of IR", for every neighborhood fl of S \ {x} in IR", there exists a neighborhood 
ri' of 5 \ {x} in R", satisfying H2.17|) . such that every trajectory of the closed-loop 
system ()1.1|) with the optimal controller, joining a point x € (H" \n) H K to x, is 
contained in M" \ fi'. 

By definition of the cut locus, and using ProDOsition l3.fil every optimal trajectory 
joining a point x G (M" \ H K to x does not intersect S, and thus has a positive 
distance to the set S. Using the assumption of the absence of nontrivial singular 
minimizing trajectories starting from x, a reasoning similar to the proof of Lemma 
13.91 proves that the optimal flow joining points of the compact set (R" \n) D K to x 
is parameterized by a compact set. Hence, there exists a positive real number 5 > 
so that every optimal trajectory joining a point x G (R" \ H K to x has a distance 
to the set S which is greater than or equal to 6. The existence of fi' follows. 

3.2.5. Robustness properties of the optimal controller. In this section, we 
prove robustness properties of the Caratheodory solutions of system (|2.1ll in closed- 
loop with this feedback optimal controller. Given e,d : R" x [0, -l-oo) R", the 
perturbed system in closed-loop with the optimal controller (denoted Uopt) writes 



Since the optimal controller is continuous outside the singular set S, it enjoys a natural 
robustness property, stated below. In the next result, the notation d(x,S) stands for 
the Euclidean distance from x to S. 

Lemma 3.11. There exist a continuous function popt : R ^ R satisfying 



and a continuous function Sopt ■ [0, +oo) — > [0, -f oo) of class /Coo such that the follow- 
ing three properties hold: 

• Robust Stability 

For every neighborhood fl of S, there exists a neighborhood H.' C of 5, such 
that, for all e, d : R" x [0, -l-cxo) R" satisfying the regularity assumptions 
(|2.2|) and, for every a; e R", 

sup[o,+oo)|e(a;, •)! Popt{d{x,S)), esssup[o,+oo)M(2;, ■)! ^ Popt{d{x,S)), (3.8) 

and for every xq G R" \ fi, there exists a unique Caratheodory solution 
x{-) of H3.6(l starting from xq, maximally defined on [0, -|-cx)), and satisfying 
x{t) e R" \ n', for every t > 0. 

• Finite time convergence 

For every i? > 0, there exists Topt — Topt{R) > such that, for all e,d : 
R" X [0, +oo) R" satisfying the regularity assumptions 1)2. 2|) and H3.8|) . for 
every xq G R" with \xo — x\ ^ R, and every maximal solution x{-) of (|3.6|l 
starting from xq, one has 



x{t) = f{x{t),Uopt{x{t) + e{x{t), t))) + d{x{t), t). 



(3.6) 



Pop*(e) >0, V^^O, 



(3.7) 



\x{t)-x\ ^Sopt{R), Vt ^0, 



(3.9) 



x{t) = X,yt^ Topt, 



(3.10) 



and 



\uopt{x{t))\\ s; 1, Vi ^ 0. 



(3.11) 
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• Optimality 

For every neighborhood fl of S, every e > 0, and every compact subset K of 
H", there exists a continuous function p^jf : H" — > II satisfying (|2.9|) such 
that, for all e,d : H" x [0, -|-cx)) R" satisfying the regularity assumptions 
and 

sup[o,+oo)|e(a;, •)! < mm{popt{d{x,S)),p,,K{x)), 
esssup[o,+oo)M(a;, •)! ^ min(popt(d(x,5),pe,if(x)), Va; S R", 

and for every G X n (R" \ fi), the solution of (|3.t)|) . starting from xq, 

reaches a; within time rg(a::o) + e. 
Proof. Since Caratheodory conditions hold for the system H3.6|l . the existence 
of a unique Caratheodory solution of H3.6(l . for every initial condition, is ensured. 
The inequality H3.11(l follows from the constraint p.2|l . Since the optimal controller 
Uopt defined by 1)3. 5|l is continuous on R" \ S, Lemma 12.141 implies the existence of 
Popt '■ R" [0, +oo) so that the robust stability and the finite time convergence 
properties hold. 

The so-called optimality property follows from the definition of Uopt, from the 
continuity of solutions with respect to disturbances, and from the compactness of the 
set of all solutions starting from K U (R" \ fi). □ 

3.3. Definition of the iiybrid feedback law. A switching strategy must be 
defined in order to connect the first component (optimal controller), and the second 
component (consisting a a set of controllers, stated in Lemma f2. 131) . The switching 
strategy is achieved by adding a dynamical discrete variable and using a hybrid 
feedback law, described next. 

3.3.1. Definitions. Let T — {1, . . . , 7}, and TV be a countable set. In the sequel, 
greek letters refer to elements of JV. Fix oj an element of Af. We emphasize that we do 
not introduce any order in Af. However, intuitively, we consider that lu is the largest 
element of TV, i.e., lo is greater than any other element of TV (see in particular Remark 
EEl below). 

Given a set-valued map F : R" =t R", we define the solutions x(-) of the differen- 
tial inclusion x S F[x) as all absolutely continuous functions satisfying x(€) £ F{x(ty) 
almost everywhere. 

Definition 3.12. The family (R" \ {x),[(S^a.i)i<^T,ga)a(^M) is said to satisfy 
the property (P) if: 

1. for every (a, X) £ TV x JT, the set ^a.i is an open subset of R"; 

2. for every a G TV, and every m > I d 

^a,i C c\os{ila.i) C ila,™; (3.13) 

3. for every a in Af, ga is a smooth vector field, defined in a neighborhood of 
clos(r2Qj), taking values in R"; 

4. for every (a, I) G Af x I ^ 6, there exists a continuous function pa,i : R" 

[0, -foo) satisfying Pa.i{x) ^ whenever x ^ x such that every maximal 
solution x{-) of 

x<Ggo,{x)+B{Q,p^j{x)); (3.14) 
defined on [0, T) and starting from d^la.i, is such that 



a;(t) e clos(r!„j+i), Vt e [0,r); 
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5. for every I E T , the sets (S^aS)ai^H form a locally finite covering of M" \ [x]. 
Remark 3.13. Some observations are in order. 

• First note that this notion is close to the notion of a family of nested patchy 
vector fields defined in However note that, in general, the sets (J^q./, (7q) 
may not be a patch as defined in ^|3H]. Indeed, due to the property 4, the 
set ^a,i may not be invariant for the system 13.14|l . Since the notion of a 
patch is one of the main ingredients of the proofs of 40 , we cannot apply 4(3| 
directly, even though some notions are however in common (see in particular 
Definition 13.141 below) . 

• On the one hand, the function pa,i allows to get robustness with respect 
to external disturbances. On the other hand, the gap between the different 
patches given by H3.13|l allow to get robustness with respect to measurement 
noise (see Definition l3.16l below for a precise statement of an admissible radius 
of measurement noise and external disturbances). 

• To state our main result, we need consider a family of three nested patchy 
vector fields. The patches 1, 2, 3, 4 and 6 define the dynamics of the discrete 
component of our hybrid controller (see Definition 13. 141 belowl . The patch 5 
is used for technical reasons to handle the measurement noise. 

We next define a class of hybrid controllers as those considered in Section |21 (see 
also gni). 

Definition 3.14. Let (R"\{x}, {{S^a,])i^T,9a)ai^M) satisfy the property ("P) as 
in Definition 13. 121 Assume that, for every a in A/", there exists a smooth function ka 
defined in a neighborhood of ^a.i and taking values in M™, such that, for every x in 
a neighborhood of r2a,7, 

ga{x) ^ ]{x,ka{x)). (3.15) 

Set 

Br = (3.16) 

Da,2 = lR"\f^a,6. (3.17) 

Let (C, D, k, kd) be the hybrid feedback defined by 

C - {(x, a) I X e (clos(f]„^4) \ f^ca) }, (3.18) 

1) = {(x,a) I X e Di Ul?a,2}, (3.19) 
fc : R" X ^ R™ 

{x,a) ^ ka{x) if xGfta.7, (3.20) 
else, 

and 

fed : R" X AA ^ Af 

{x,a) 1-^ uj, if a; G clos(17ij_i n i^i) and if X ^ I?a,2, (3-21) 
a', if a; e clos(17ct/4 n Da^)- 

The 4-tuple (C, D, k, kd) is a hybrid feedback law on R" as considered in Section 
12.21 We denote by 'H[e,d) the system ()2.1f) in closed-loop with such a feedback with the 
perturbations e and d as measurement noise and external disturbance respectively. 

Remark 3.15. In this definition, we do not use any order in J\f. However, in 
light of (40], we consider that uo is greater than any other element of TV. This element 
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to has a particular role in the sequel, since it will refer to the optimal controller in the 
hybrid feedback law. 

This hybrid controller takes advantage of the existence of regions where different 
controllers ka exist and, roughly speaking, allows the hybrid variable to choose be- 
tween the different controllers. This is the main idea of the hysteresis as done in [37] 
to unit two controllers. 

Note that the concept of a hybrid feedback law of Definition 13.141 is similar to 
the one of 40 . However, in 40 , the hybrid feedback laws are derived from a family 
of patchy vector fields, whereas they are here derived from a family satisfying the 
property {V) as considered in Definition 13. 121 

3.3.2. Properties of solutions. In this section, we investigate some properties 
of the solutions of the system in closed-loop with the hybrid feedback law defined 
above. 

Definition 3.16. Let x ■ ^ IR be a continuous map such that > 0, for 
every x ^ x. 

• We say that % is an admissible radius for the measurement noise, if, for every 
X G R" and every a such that x G ^aj^ 

X{x)<\- min d(]R"\n„.,+i,r!„,0- (3-22) 
2ie{i,...,6} 

• We say that x is an admissible radius for the external disturbances if, for 
every x G IR", we have 

x{x) < max Pq,/(x). 

There exists an admissible radius for the measurement noise and for the external 
disturbances (note that, from (|3.13|l . the right-hand side of the inequality H3.22|l is 
positive) . 

Consider an admissible radius x for the measurement noise and the external 
disturbances. Let e and d be a measurement noise and an external disturbance re- 
spectively, such that, for all {x,t) e H" x [0, +cxd), 

e{x,t)^x{x), d{x,t) s^xix). (3.23) 

The properties of the solutions of the system in closed-loop with the hybrid feed- 
back law defined in Definition 13 . 141 are similar to the ones of 00]. Hence, we skip the 
proof of the following three lemmas which do not use Statement 4 of Definition 13. 121 
but only the definition of the hybrid feedback law. 

Lemma 3.17. For all (a;o, so) G IR-" x A/", there exists a solution of 'H{e,d) starting 
from (a;o,so). 

Recall that a Zeno solution is a complete solution whose domain of definition is 
bounded in the f-direction. A solution (x, s^), defined on a hybrid domain S, is an 
instantaneous Zeno solution, if there exist f ^ and an infinite number of j G IN such 
that (i, j) G S. 

The Zeno solutions do not require a special treatment. 

Lemma 3.18. There do not exist instantaneous Zeno solutions, although a finite 
number of switches may occur at the same time. 

We note, as usual, that maximal solutions of fi^cd) blow up if their domain of 
definition is bounded. Since Zeno solutions are avoided, the blow-up phenomenon 
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only concerns the t-direction of the domain of definition, and we get the foUowing 
result (see also |25,; Prop. 2.1]). 

Lemma 3.19. Let {x,Sd) be a maximal solution of Ti-^cd) defined on a hybrid 
time S. Suppose that the supremum T of S' in the ^-direction is finite. Then, 

limsup Z)| — +00. 

t-»T,(t,/)es 

We conclude this series of technical lemmas by studying the behavior of solutions 
between two jumps. For every a G M, set 

Tq — sup{T I a; is a Caratheodory solution of x = f{x, k^) + B{0, x{x)) 

with x{t) e n^j, Vt e [0,T)} . 

(3.24) 

Note that there may exist a £ f\f such that = +oo. 

Lemma 3.20. Let {x, Sd) be a solution of 7^(6, d) defined on a hybrid time domain 
S and starting in (H" \ {x}) x Af. Let T be the supremum in the t-direction of S. 
Then, one of the two following cases may occur: 

• either there exists no positive jump time, more precisely there exists a € Af 
such that, 

1. for almost every t e (0,T) and for every I such that {t,l) G S, one has 
k{sdit,l)) = ka, 

2. the map a; is a Caratheodory solution of x ~ f{x, k^) + d on (0, T, ); 

3. for every t S (0,r), and every I such that {t,l) G S, one has x{t,l) + 
e{x{t,l),t) e clos(fia,4) \ Vt^.i] 

4. for aU {t,l) e S, t > 0, one has x{tj) + e{x{t,l),t) ^ D, where D is 
defined by (|XT^ : 

5. the inequality T < holds. 

• or there exists a unique positive jump time, more precisely there exist a S 
M\ {uj} and ti e (0,T) such that, letting to — 0, t2 — T, ao = a, ai — uj, 
for every j = 0, 1, the following properties hold: 

6. for almost every t G (tj,tj+i) and for every I such that {t,l) £ S, one 
has k{sd(tj)) = kaj] 

7. the map x is a Caratheodory solution of i = f{x, ka^) + c? on {tj, ij+i); 

8. for every t £ (io,ii), and every I such that {t,l) £ S, one has x(t,l) + 
e{x{t,l),t) £ clos(ria,4) \ n^X' 

9. for every t in (tj, ij+i), and every I such that (t, I) £ S, one has x(t, I) + 
e{x{t,l),t) ^ Daj,2, where is defined by H3.17() : 

10. the inequality ti < Ta- holds. 
Proof. Consider the sequence {tj)jem of jump times, i.e., the times such that 
tfj — Q and, for every j £ to, j to — 1, 

tj tj+i , (3.25) 

(2;(ij+i,i) + e(a;(tj+i,j),tj+i),Sd(ij+i,j)) £ D , (3.26) 

and 

i^itj+i J + +e{x{tj+i,j), t-i+i),sd{tj+i,j + nj)) £C , (3.27) 

where rij is the finite number of instantaneous switches (see Lemma I3.18|l . Let a : 
IN ^ IN be an increasing function such that < ^ctQ+i) ■ 
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Between two jumps, Sii(t) is constant, and thus, there exists a sequence (a^) in 
J\f such that, for every t G (^cr(j), ia{j+i))i except for a finite number of t, we have 

Sd{t,<j{j))=aj, (3.28) 
a: is a Caratheodory solution of i = f{x, ka^) + d on (^(T(j)ji(T(j+i))i (3.29) 



k[sd[t,G{3)))^K^. (3.30) 
From (|3.18() . 13.27|l and (|3.28() . we have, for every t S [t<T(j),'t<T{j+i)\, 

x{t,j) + e{xit,j),t) e c\os{ng^A)\^uj,i. (3.31) 

Note that, from (|OT|) . and Statement 4 of Definition ITT^ for every i > 

such that t e [ta(j)itcr{j+i)], one has 

a;(i,a(j)) ^i?„^.^2. (3.32) 

Therefore, the positive jump time may occur only at time tj where the point x{tj, I) + 
e(x{tj, I), tj) belongs to Di. Thus, there exists at most one positive jump time. From 
l|3.29fl and H3.30|l . Statements |21 6, 7 hold. Statements O and 8 are deduced from 
l)3.31|l . Equation (|3.32|) implies Statements 0] and 9. Finally, Statements |S1 and 10 are 
a consequence of (|3.24f) and (|3.29|I .D 

3.3.3. Definition of the hybrid feedback law, and switching strategy. 

We next define our hybrid feedback law. Let e > and X be a compact subset of 
M". Let ri be the neighborhood of S given by Lemma f2. 131 For this neighborhood 
il, let J7' C be the neighborhood of iS yielded by Lemma [2. 141 
Let M be the countable set defined by 

J\f = {{i,p), i e N, p e M} u {lu}, 

where u is an element of INf x IN, distinct from every (i,p), i e IN, p e A/i. 

We proceed in two steps. We first define and fla.i, where a G A/" \ {uj} and 
I e J-. Then, we define k^^ and ^uj,i, where I £ J-'. 

1. Let i e IN. Lemma |2. 131 applied with the stratum Mi, implies the existence 
of a family of smooth controllers {ki_p)pi=f^. satisfying the constraint H1.2|l . 
and of a family of neighborhoods (f^i.p.7)peA/i ■ The existence of the families 
(f^i,p,i)pGA^i, ■ • • , {^i,p,6)peAr,, satisfying 

^i.p.l £ clos(r2j_pj) ^ ^i.p.ni: 

for every m > I ^ T , follows from a finite induction argument, using Lemma 

ESI 

We have thus defined ki^p and ^i^p^i-, where (i,p) G A/'\ {w} and / G J-. 
Remark 3.21. It follows from jTj that, near the point x, the cut locus S is 
contained in a conic neighborhood C centered at x (as shaped on Figure |OJ, 
the axis of the cone being transversal to the subspace Span{/i(a;), . . . , /m(a;)}- 
Hence, up to modifying slightly the previous construction, we assume that, 
near x, the set Uq6A^\{uj} ze.?' contained in this conic neighborhood. 



20 



C. PRIEUR AND E. TRELAT 



2. It remains to define the sets fl^j, where / G and the controller k^^. Let 
be an open set of H" containing H" \ UaeAAXfo)} ^q.i ^^'^ contained in 
IR"\5. From the previous remark, the point x belongs to clos(f2ij_i). Lemma 
12.141 applied with fl = R" \ clos(r2(j_i), allows to define k^^ as kopt, and fi' a 
closed subset of H" such that 

n' C n, (3.33) 

and such that fi' is a neighborhood of S. Set = H" \ 5^'; it is an open 
subset of H", contained in M" \ S. Moreover, from 13.33|1 . 

^uj,i C clos(17^^i) C fl^ 2- 

The existence of the sets ■ ■ ■ ,^ui,7 follows from a finite induction ar- 

gument, using Lemma [2. 141 Moreover, from Lemma [3.111 we have the fol- 
lowing property: for every I e {1,...,6}, for every xq G ^uj,i, the unique 
Caratheodory solution x{-) of (|3.6|) . with x(0) — xq, satisfies x{t) £ fl^^^i+i, 
for every t ^ 0. 

Therefore, (H" \ {x}, {{Qa,i)ieJ^,ga)aeAf) is a family satisfying the property {V) as 
in Definition 13. 121 where ga is a function defined in a neighborhood of fla.7 by 

ffa(a;) = f{x,ka). 

The hybrid feedback law (C, D,k,kd) is then defined according to Definition 13. 141 

3.4. Proof of Theorem 12.11)1 Let e > 0, and be a compact subset of M". 
Consider the hybrid feedback law (C, D, fc, kd) defined previously. Let x be an admis- 
sible radius for the external disturbances and the measurement noise (see Definition 
I3.1t)|) . Up to reduce this function, we assume that, for every a £ J\f\{uj}^ 

xix) Popt{d{x,S)), \/xeQ.^^7, (3.34) 
xix) ^ Pa{x), yx £ flaj. (3.35) 

Note that, from the choice of the components of the hybrid feedback law, and from 
Lemmas 12.131 and 13.201 for every a £ JV \ {uj}, the constant Tq defined by H3.24|l is 
such that Ta < e. 

Let us prove that the point a; is a semi-global quasi-minimal time robust sta- 
ble equilibrium for the system 7i(e,d) i^i closed-loop with the hybrid feedback law 
(C, D, k, kd) as stated in Theorem 12. 101 

Step 1: Completeness and global stability 

Let R> Q and 5 : [0, -\-oo) [0, -l-oo) of class ICoo be such that, for every a £ N\{lo}, 

5{x) < 5opt{R). £ r!^,7, (3.36) 
5{x) (5„(i?), Va; £ VL^.y, (3.37) 

where the functions 5a are defined in Lemma l2.13l Let e, d be two functions satisfying 
the regularity assumptions and H3.23|l . Let (a;, Sd) be a maximal solution of 'H(e.d) on 
a hybrid domain S starting from (xo,so)i with |a;o| < R- From Lemmas 13.111 1^.131 
and l3.20l we have, for every [t,l) £ S, 



x{t,l) -x| «C S{R). 



(3.38) 
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Therefore, the conclusion of Lemma l3. 1'^ cannot hold (since limsupf^y {t i)£S 01 
+00), and thus, the supremum T of in the t-direction is infinite, and the maximality 
property follows. The stability property follows from H3.38|l . 

Step 2: Uniform finite time convergence property 

Let xq e B{x, R), and sq G Af. Let (x, Sd) denote the solution of 'H(e,d) starting from 
{xq, So). If Xq — X, then, using (|3.20() and the fact that x{x) = 0, the solution remains 
at the point x. We next assume that xq ^ x. Let ao G A/" such that x{-) is a solution 
of i = /(x, {x)) + d on (0, ti) for a > given by Lemma 15. 201 

li = uj, then the feedback law under consideration coincides with the optimal 
controller and, from Statement^ of Lemma [3. 201 there does not exist any switching 
time t > Q. Then, from Lemma 13.111 x(-) reaches x within time Tx{xq) + e. 

If ao 7^ cij, then, from Lemmas 12.131 and 13.201 the solution x{ ) leaves ^aoj within 
time e and then enters the set ^ujj. Therefore, since Tq < e, x{-) reaches x within 
time Tx{xi) + e, where xi denotes the point of x{-) when entering ^u}j- 

Let t{R) = \aaXx£5{R) T{x) + e. With (|3.38() . we get H2.12|l and the uniform finite 
time property. Note that, from Lemma [2. 131 the constraint (|2.13(l is satisfied. 

Step 3: Quasi- optimality 

Let K he a compact subset of R", and (xo,so) ^ K x M. Let i? > such that 
K C -6(0, R). From the previous arguments, two cases occur: 

• the solution starting from (xq, sq) reaches x within time Tx{x{)) + e whenever 

• the solution starting from (a;o, sq) reaches x within time Tx{xi) -l-e, whenever 
ao 7^ LiJ, where xi denotes the point of x{-) when entering ric^^y. Up to reducing 
the neighborhoods ^a,i, one has |Tj(a;o) — Tx{xi)\ ^ e. Indeed, from Remark 
12.41 the function Tx{-) is uniformly continuous on the compact K. 

Hence, the maximal solution starting from (xq, sq) reaches x within time Tg(xo) + 2e. 
This is the quasi-optimality property. 

Theorem 12. 101 is proved. 

Acknowledgments. The authors are grateful to Ludovic Rifford for constructive 
comments and suggestions. 
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